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Political cwHiuni'^ation researchers recently have 
anphasized conditional relationships as crucial to specifying and 
understanding tha effects of the aass aedia. In aany cases, however, 
researchers will not predict which variables will aodiCy the forn or 
existence of aedia effects. They therefore will not in^:lude aeasures 
of the conditional variables in research designs. The presence of 
heteroscedasticity, or unequal precision of prediction at different 
levels of an independent variable, suggests the likelihood of an 
overlooked conditional relationship. This paper exaaines the 
possibilities for the use of statistical tests of variation in aass 
coanunication research. Research situations that eaploy both discrete 
and continuous independent variables are covered, and the visual 
examination of scatterplots at an alternative to perfoming 
variability tests is exaained. Probleas with the variation tests 
available on coaaonly used coapvter packages is addressed. A nuaber 
of recently developed, apparently dependable variability tests also 
are presented. A research exaaple involving two-way, linear 
interactions is provided. Additional concerns with unequal 
variability are also discussed. Three figures and a four-page list of 
references are included. (Author/PN) 
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Political communication rettarchert ractntly have emphasized 
conditional relationships as crucial to specifying and 
understand! « effects of the aass media. In many cases, 
however, reseatchero will not predict which variables will modify 
the form or existence of Mdla effects. They therefore will not 
Include measures of the conditional variables In research designs. 
The presence of heteroscedastldty , or unequal precision of 
prediction at different levels nf an Independent variable, 
suggests the likelihood of at? overlooked conditional relationship. 
This paper discusses statistical and visual ways of looking for 
heteroscedastidty In designs employing both fixed and sampled 
independent variables. It presents an example from actual 
research. It also discusses additional reasons researchers may 
want to be concerned with unequal variability. 



Looking for flctero«ctd«8tlclty: A Heans of 
Searching for li«gltct«d Conditional Relationships In 
Political Communication Research 

Almost all the greatest discoveries In astronomy have 
resulted from the consideration of what we have alsevhere 
termed RESIDUAL PHENOMENA, of a quantitative or numerical 
kind, that Is to say, of such portions of the nuaerlcal or 
quantitative results of obee atlon as remain out Jtandlng and 
unaccounted for after subducting and allowing for all that 
would result from the strict application of known principles^ 
(Sir John F. W. Herschel, as quoted in Draper & Smith, 1981, 
p. 141) 

Perhaps the most Important reason to identify and study 
heteroscedastidty is that it may provide the only available 
evidence of interacting variables. Existing computer 
programs can search data sets for evidence of simple 
interaction; however^ a finding of heteroscedastidty can 
provide a rationale for suspecting interaction with variables 
not Included in che data set. (Downs & Rocke, 1979, p. 826) 



Researchers in most scientific fields are quite familiar with 
what statisticians call a simple interaction: a situation in 
which the effect of one factor upon another, or the association of 
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one variable irtth another, changes at different levels of a third 
factor. Pharoadsts and nedlcal doct^^rs, for exanple, have long 
realised that some conblnations of drugs have synergistic effect* 
on patients. If taken together, alcohol and oarblturates cause • 
■uch greater level of intoxication In people than would result 
from the additive, Independent effects of the two. As another 
example, sociologists have provided evidence that the relationship 
between people's attitudes and behavior changes as social 
situations vary (Acock k DePleur, 1972). 

Polltlcal-coomunlcatlon researchers also frequently study 
interactions, in recent years, they increasingly have theorized 
about conditional and contingent effects of the mass media (e.g., 
McCombs, 1981; McUod & Becker, 1981). A condition^ effect 
occurs when the Impact of the mass media varies among different 
types of person-, or situations (McLeod & Reeves, 1980). A 
contingent effect—a specific form of conditional relationship- 
exists when an effect occurs only for certain people or in some 
situations. 

The knowledge-gap hypothesis, for example, (Tlchenor, 
Donohue, & Ollen, 1970) predicts a conditional relationship 
between the availability of information from the mass media and 
people's learning of that informttion. Persons of higher 
socioeconomic status (SES) are expected to learn infcnnation 
contained in the media more rapidly than are lower-SES people. 

Such research offers the prospect of an empirical synthesis 



ERIC 



5 



3 

of two opposing strands in research in the field (McLeod & Becker, 
1981, p. 72): the hypodermic nodel of the poet World War I era 
and the United-effects model • The former posited uniformly 
powerful media effects (see DeFleur A Ball*Rokeach, 1975, for a 
discussion). The latter model (Lacarsfeld, Berelson, 4 Gaudet, 
1948; Klapper^ 1961) followed research evidence that the mass 
media typically do not have a po%^rful lapact on the attitudes and 
behavior of their audiences. 

Persons testing conditional hypotheses often attempt to 
specify situations in which the media exert important Influences, 
in the absence of uniformly powerful effects. MetnodologicAlly 
this implies a search for interaction. Researchers are advised lo 
go beyond experiments that explore only main or overall effects 
(e.g., one-way designs) and survey analyses that use regression 
equations containing only an additive combination of predictors. 
Instead, they can examine media effects within subgroups 
differentiated by third variables such as SES (e.g., McNelly & 
Molina, 1972) or by including Interaction terms in data analyses 
(e.g.. Miller & Reese, 1982). McLeod & Reeves (1980, pp. 19-24) 
provide numerous examples of the many forms that Interactions may 
take. They also discuss the imprecise or Incorrect inferences one 
may make based upon data analyses that Ignore combined effects of 
variables. 

In certain cases, a researcher may Include in surveys or 
experiments measures of concepts that he or she expects to 
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Interact vith aedla atlQull In producing an affect. One then can 
tMt an interaction for statistical significance. In nany cases, 
however, theorising about conditional relationships still Is In a 
state of relative infancy. Researchers often vlll not predict 
when or if conditional relationships nay earls t, and they will not 
Include neasures of the relevant third variables as part of their 
research designs. 

In these situations we need a aeans of checking whether an 
independent variable is likely to combine with an unspecified 
factor to Influence a dependent variable. Statistical tests for 
heteroscedastlcity (lack of homogeneity of error variation) or 
visual examinations of the uniformity cf error represent 
reasonable, although less than perfect, means of examining an 
assumption of no interaction. In many research situations, 
unequal variability in a dependent variable at different levels of 
an independent variable indicates the strong possibility of an 
interaction (Downs & Rocke, 1979). 

Such a finding should represent a warning to exercise care in 
interpreting results. It also should suggeft":: the desirability of 
collecting additional data to try to find out with which factor an 
independent variable is Interacting. In the present paper the 
possibilities for the use of statistical tests of variation in 
mass communication research will be examined. Research situations 
that employ both discrete and continuous independent variables are 
covered, and the visual examination of scatterplots as an 
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•Ittrnatlve to perfonloe variability tMt« Is exaalned. Problems 
irlth the variation tests available on coomonly used computer 
packages will be addrassad. A nunibar of recently developed, 
apparently dependable variability tests also ace presented, and a 
research example utUlslng one of them Is provided, 

EXAMINING VARIATION: EXPERIMENTAL DESIGNS 

In many cases, experimental researchers In mass 

communications associate tests on variances and variability with 
an assumption required by many inferential data-analytic 
techniques. Many of the Bost-comoon statistical tests for 
differences between or among group means — ^for example. Student's t 
and the F test— assume that wlthln-group population variances are 
equal for all groups Included in a study. A finding that group 
variances appear heterogeneous can mean that researchers lose some 
degrees of freedom in their tests and therefore need larger sample 
sizes to attain the same power. Generally, most researchers 
probably ignore variation tests entirely, in large pert because 
atandard experimental -de sign and statistics texts (e.g., Winer, 
1971; Kirk, 1982) stress the robustness of the t and F tests to 
violations of the equal-variance assumption. 

A few researchers in fields such as psychology, however, have 
understood that unequal variation may contain interest even 
without different group measures of central tendency. For 
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cxamplt, • study thovad that perfomanct in a concapt«laarnlng 
axparlnen^ via lata varlabla with a huaan axparlmantar than when a 
computar aazvad aa the axparlMnter« Thla occurred in y^vt 
becauae the huaan experimenter provided inadvertent taak-related 
cues that aided lov-ability subject a taore than high-ability 
aubjecta (Jrhnaon & Baker, 1973). In effect, the type of 
expcriaenter interacted vith the ability of aubjecta to Influence 
the outcome* 

One hypothetical example from nasa-communication research may 
help illuatrate the point. Figure 1 depicta a case in which 
researchers have manipulated experimentally a factor that has 
equal and opposite effects for men and women on aome important 
criterion variable (auch a relationship might have emerged last 
fall if one had exposed men and women to Reagan campaign material 
and then questioned aubjecta'^ attitudes toward the president )« 
Assume that the subjects included approximately equal numbers of 
each aex« If the experimenter did .lot utilise gender aa an 
experimental variable, a teat on group means would show no 
differences between treatment and control aubjecta. If variances 
about the means within each combination of aex and treatment or 
control group are eqtial, the aubjecta in the treatment group will 
exhibit greater variation than control aubjecta. Of courae, had 
the researchera collected data regarding subjects'* gender, they 
could easily test the interaction directly. If they failed to 
collect these data, however, unequal variation would represent the 
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only ttvldencft of the inttraction. Caution In concluding that thct 
axperlnental traatntnt had no affact on people alao would be 
advlaable. 



Figure 1 About Here 



A coDnon belief that available teata of variability are 
untruatvorthy repreaanta one poaalble obatacle to the acceptance 
of such methoda In checklmg an aeaumptlon of no Interaction. The 
most common teat of the equality of group variability 
unfortunately la among the leaat reliable of all coononiy 
encountered atatlatlcal methods. A researcher constructs this 
test statistic by taking the ratio of one group variance to 
another. The ratio then la compared with a critical value found 
In an F table with degrees of freedom equal to one fever than the 
nunber of aubjects In the first group and one fewer than the 
number of aubjecta In the second group. Like many other 
statistics 9 this requires an assumption that aamples are drawn 
from normally distributed populations. Unlike what la commonly 
thought about most tests, however, the Central Limit Theorem does 
not allow a researcher using this particular F test to relax the 
assumption with moderate or large sample alzes (Hays, 1973). 
This test cannot be relied on with populations a researcher knows 
to be non*normal or with unknown populations* 
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Statisticians hav« dsvaloped i.nd nplorad a nunber of 
alt trnat Ives to this F ttst and Ita ganerallsatlon co research 
Involving no re than two groups, Rartley'a '«ax* ^^'^^'^^•^•lyt 
the alternatives aost commonly encountered on atandard computer 
packages— Bartlett'a chl-square and Cochran'a C~are similarly 
nonrobust to lack of normality (O'^Brlen, 1981). The Levene test 
(Levene, 1960) available on BMDP also aeems to have the same 
problem (Brown & Forsythe, 1974)# 

Apparently trustworthy tests, hot/ever, are available to an 
Industrious researcher, and some are quite easy to use* Following 
a critical synthesis of findings concerning the robustness of 
variance homogeneity tests, one methodologlst (Keppel, 1982) 
recommended use of the Box test (Box, 1953) when evidence of 
asymetrlcal populations exists* The Box test Involves dividing 
subjects within an experimental cell Into small groups and 
calculating sample varlanci»3 for each small group* A researcher 
then applies a logarithmic transformation to these variances, 
which become the obsKvatlons for an Anova-type analysis (see 
Winer, 1971, pp. 219-220 for a clear explication of this 
procedure). Another statistician recently haa developed a much- 
simpler alternative to this procedure (O'Brien, 1981). The W50 
test, in which the dependent variable consists of the absolute 
devlaclons from cell medians, also aeems robust to population non- 
normality (Brown & Forsythe, 1974). 

One possible alternative to testing for inequality of 
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varlancM It a visual axaal nation of a ccatterplot such as Figure 
I. One picture^ sons alght argue » Is worth a thousand test 
statistics. In Atny situations one can easily detect 
heterosceda^wlclty visually, and researchers always should examine 
these plots. In some cases, however, unequal error variation will 
not be visually evident, because ^^e eye tends to look only for 
unequal ranges. In other Instances, sampling error can produce 
what appears to be heteroscedastlclty. Statistical tests allow a 
researcher to conclude formally whether an assumption of equal 
variation appears plausible. 



EXAMINING VARIATION: SURVEY RESEARCH 



Many survey resesrchers in communications, who often use 
simple- and mult 1 pie -*r egress ion techniques, are aware of the 
homogeneity of variance assumption. Host, however, probably 
Ignore the assumption entirely. Others, upon detecting evidence 
of heteroscedasticity in a scatterplot, follow common advice 
(e.g.. Draper & Smith> 1981) to transform the dependent variable 
to attain an apparent equality of variation. A few may use 
complex weighted lea8t-»8quares techniques. Such practices reflect 
a common attitude that regression analysis exists to find average 
or predicted values of a dependent variable, and unequal variation 
merely represents a nuisance interfering with this aim (Downs & 
Rocke, 1979). Few appear to realise that heteroscedasticity can 
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suggest M Incorrectly spscifled Mdtl. 

Unfortunattly, survey rtstarchtrs frtqusntly vlll have 
trouble using casts craatad to axaalna hataroacadastldty In 
axparlmantal daslgns, vhlch contain dlacrata Indapandant 
varlabXaa. Thalr pradlctor variables ara usually aanplad and not 
fixed by the rf^seavcher pi:lor to the study, and they often do not 
have aore than one obaervatlon at any one level of an Independent 
variable or conblnatlon of variables (see Figure 2). 



Figure 2 About Here 



On the other hand, statisticians have developed tests that 
fit this situation. Goldfeld and Quandt (1965) suggested t^o of 
the best known of these statistics.^ Their tests apply In 
situations In vhlch a researcher vonders whether error variation 
Increases or decreases as one wes from lower to higher levels of 
an independent variable. The first test, a aodlfled version of 
the F test on variances discussed earlier, requires an assumption 
of ^ror normality. The other, the nonparametrlc peak test, 
requires no such assumption. Clejser (1969) suggested another 
test, which involves use of the ebsolute values of residuals as a 
dependent variable. With regression analysis, a researcher then 
could explore whether any significant relationship existed between 
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one or won Indtpendent varlablts and the rt8lduals« Thfs test 
could apply In sltuatlont In vhlch rMlduals appeared larger 
toward the central valoea of an independent variable and amaller 
tovard large and aaall values » or vice veraa« One could explore 
whether a quadratic relationship axiated between the independent 
variable and the absolute value of residuals » for exaaple. 

A question can arise concerning whether hateroscedasticity 
with reference to a predicced dependent variable <a conoon neans 
of plottfng date in aultiple regression)^ rather than relative to 
a aingle independent variable » can suggest a neglected 
interaction. The answer is yes. If the residuals fron a multiple 
regressiou analysis are nonally distributed with a constant 
variance 9 the distribution of the dependent variable Riven a 
single independent variable also is nonnal with a constant 
variance (Downs & Rocke» 1979» p. 827>« 

EXAMPLE 

The following example illustrates the utility of a test of 
homogeneity of variance in an experimental design. The debate 
over a New International Information Order (Masmoudi^ 1979), which 
has featured complaints by the developing nations that the Western 
press covers underdeveloped trees of the world in a sperse and 
biased manner, suggested the research question* Perry (1984) was 
Inter^^ted in the inferences people form about foreign nations 
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froD •aaplcs of Information suppllad by the n«v« Mdla. He 
predict ad that stnaatlonal nawa artldea would hava oora influance 
on tha accuracy of paopla'a laagaa of davaloplng countrlaa than on 
their judgaenta about developed natlona. 

A newa atory deacrxblog a iBall group of people In Ecuador 
with extrcnely lengthy life apana vaa uaed to teat the l^potheala 
that news atorlea would have a ■ore-^aaglng iapaet on the 
accuracy of judgnenta people aake «bout developing countrlea than 
on their Inferencea regarding developed nations, ferry «lao uaed 
a almple random sample of 19 European and 19 African nations. The 
news story was typeaet 38 times, with the name of each country 
substituted for Ecuador. Actual longevity flgurea mentioned in 
the artlclea were altered for the varloua countrlea so that each 
flguta was, aa much aa poaalble, the aame degree greater than the 
actual life expectancy for residents of each country. 

The experimental aubjecta consisted of 76 students attending 
a atatc university during the summer of 1984. Ferry asked the 
subjects to estimate the life expectancy of people In one of the 
38 countries, to which they were aaalgned at random. Prior to 
making such an estimate, half the atudenta read a news story 
concerning the country. Therefore, two students— one who had read 
a atory and one who had uot-^erlmated longevltlea of people In 
each country. Perry measured the accuracy of the Inferences by 
taking the abaolute difference. In years, between each 
part Id pant 'a Inference and the actual figure. 
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RttponsM were conblntd to fon four txpcrlMntal ctlls: 
African nation/no story , African nation/story, European natlop/no 
ator)r» and European natlon/etory. A planned conparlaon Indicated 
^uppart for the conditional or Interaction hypothesis: the 
'Stories caused greater daKage to the accuracy of inferences about 
African nations than to the accuracy of inferences concerning 
European countries, t(72) • 3.26, one-tailed p<«05. Overall, the 
stories had a large lapact on the accuracy of Afrlcan-country 
subjects; students vho read a story nisstd actual life 
expectancies by an average of 47 years, and participants «9ho read 
no story provided Man estlnates that iiere only about 23 years off 
of actual longevity figures. It had such less Influence on 
European-country participants; students who read a story missed 
actual figures by an average of about 17 years, only about four 
years sore than the aean estimate of subjects not reading an 
article. 

Suppose^ however, that the researcher simply had wanted to 
study the impsct of news stories on people'^s inferences about 
foreign nations, wlv:hout regard to the geographic location of the 
countries. If he had no( Included the geographic location of the 
countries as an experimental varlaMe in the design, he would have 
no means of testing for the conditional reUtlonshlp. The 
researcher might wonder, however^ whether subjects in general 
seemed uniformly Influenced by the stories. One could explore 
this question by examining the overall effect of the story 
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treatMots on tht varln^illty of ptople's MtlnatM* A finding of 
statistical slgnlflcanct vould suggtst that tha storlas Lad a 
conditional offset on subjscts~-l»a, , dlffsrsnt offsets on various 
parsons with stimuli raflsctlmg dlffsrsnt countries. 

This sxsnpls utUlssd s trsnsfonatloni suggsstsd by 
O'^Brlsu (1981: 571) to achlsvs a robust tast of variability. 
Individual dspandsnt--varlabls obssrvatlons vithln sach of the two 
calls vers transfonssd according to tha following formula (written 
In terms of tha ^th obssrvatlon within tha ^th axpsrlmental call): 

r^j - (n^ - 1.5) n^ (y^j - 7^)^ - 0.5 a^^ . ^y^^^ ^ jj 
• 2). 

One first computes the mean and unbiased sample varlancs 
within each experimental cell. Tha reaearcher then squares tha 
difference between the first observation and its cell mean. The 
aquare Is multiplied times the product of the sample else within 
the cell and this ssnple else minus 1.5. From this figure one 
subtrscts the product of three quantities: 0.5, the wlthln^ell 
sample variance, and the wlthln«cell sample size minus 1. The 
remainder then is divided by the product of the wlthin-^cell sample 
aize minus 1 and this sample else mliius 2^ A researcher repeats 
the procedure for each observation within the experiment. 

After completing this transformation, Perry applied a two- 
sample t test to the transformed scores. In other situations, 
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standard analytat of varlanca or planned coaparltons could ba 
2 

amployad. Tha Man r valuaa rasultlng vara about 198 for the no- 
• tory aubjacta and 374 for tha story subjacta (vlth this 
transformation, tha Man r valua aquals tha original varlanca 
vlthln tha axparlMntal call)# Yha t valua for tha dlffaranca 
batvaan tha two Mana vas algnlf leant, t(7A) ■ 2.65, two-ta'^.ad 
p<«05, Indicating that tha accuracy of Infarancas aMng aubjacta 
who raad tha atory varlad Mra than tha tnfarantlal accuracy aaong 
no-atory participants. Such a pattam of hataroacadastldty would 
be produced If the stories had a aore powerfully daMglng affect 
on soM subjects than on others. Of course, In thla case ve know 
from actual reaearch that the tm%n.:!al variabilities reflected the 
conditional relationship produced by the geographical location of 
the countries Mntlonad In tha stories. 

As a final atep, Parry ragro^rped the observations Into the 
original four calls of the axperlMnt. He then recomputed 
O^Brlen^s r, reflecting the four-cell design, for each 
observation. An overall F teat for the four cells failed to 
attain significance, F(3, 72) - K68, p>.05. Indicating that an 
assumption of homogeneity of variability— and an assumption of 
lack of additional Interact lon--^^ ^ appears plausible. 

CCNCLUSION 

In this paper a case has been made for the use of tests for 
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hftttrotctdattlclty in ttplorlng whtthtr a rttcarchtr has 
ovarlookad a conditional ralationahip. ftcadtri should be varnad» 
howavar, that conditions other than Interacting variables can 
soastlMS produce heteroscedasticity. Other foms of incorrect 
wdel specification can result in vnequal variability (see 
Goldfeld t Quandt, 1965 for a discussion of one example). In 
addition, floor and ceiling effects In MasureMnt can deflate 
variances (O'^Brien, 1981), and variance tests occasionally have 
been used to test for the presence of these artifacts (e.g., 
Holsaan, Pellegrino, 4 Glaser, 1982). 

There is, of course, no guarantee that a real, but 
overlooked, conditional relationship vlll produce significantly 
unequal variation. For one thing, the power of variation tests 
usually is lower than the power of tests concerning central 
tendency (Keppel, 1982, p. 99). In addition. Figure 3 illustrates 
one hypothetical, and probably rare. Interaction pattern in an 
experimental design that would yield equal variances between a 
treatment and a control group. In this case, an Interaction 
pattern is disordinal or transverse (the lines connecting the 
treatment and control groups, within subgroups, cross), and both 
variables are dlchotomous. In addition, no main effect is present 
either for the treatment or the subgroup factor. 
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Figure 3 About Here 



More generally, vhen e researcher utilises dlchotonous 
Independent variables, ordinal Interactions (In which lines do not 
cross within the utilised raoge of Independent variables) will 
have a greater lapact than will dlsordlnal interactions on 
variability. Situations In which dlsordlnal interactions have no 
ittpect on variation probably are not too coanon, however. For 
Instance, If one Independent variable is continuous and the other 
dlchotonous, a dlsordlnal Interaction between then nomally would 
expand variability anong observations at «xtreme ends of the 
continuous variable, relative to observations toward the center. 

This paper has used exanples Int^olvlng only two-^ay, linear 
Interactions. Higher-order and nonlinear (e.g, quadratic) 
Interactions also should Influence variation In nost cases, 
although very specific situations exist In which they nay not. 

In sone cases, unequal variability nay have theoretical 
Inport, beyond possibly suggesting the presence of a neflected 
interaction. For exanple, Jeffentonlan political thought posits 
the desirability of nultlple views on public issues and a 
diversity of public opinion. Chaffee and Uilson (1977) tested 
whether audience agendas in nedia-rich towns were nore varied than 
public agendas In fl»edia*poor areas • Their dependent variable 
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attained only « nominal l«v«l of Maturoaent, and Chaffee and 
Vlleon utilised an inforutlon-theoratlc aeaeure of nominal 
diversity. Other researchers night explore whether people vho 
reed two or more newspapers exhibit sore "mrlatlon on conventional 
attitude measures than single-newspaper readers, for example. To 
do so, one could apply a variation aessure such as O'Brien's r to 
dsta generated by a Llkert-type scale, for instance. 
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Footnotes 

*A8 described In the 1965 ertlcle. the Coldfeld-Quandt tests 

•pply to Instances In which a researcher wonders whether a ratio, 

rather than linear. K>del fits a set of data. The tests would not 

be useful In situations described here If they only applied In 

that Ir^tance. They can be used In auch aore general situations, 

however (Coldfeld & Quandt, 1972, p. 85-91). 
2 , 

O'Brien (1981, p. 572) warns researchers who perform 

contrasts on a subset of cells within an experloent against using 

a pooled estlaate of the error tern following the r 

transformation. 
3 

It Is crucial to remember tliat such tests do not eliminate 
the possibility that the treatments employed In an experiment 
actually yield unequal variation. All they Indicate Is whether an 
assumption of equal population variability remains credible. 
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